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Abstract 

We consider the ground state properties of mixed Bose-Einstein condensates of 87 Rb and 85 Rb 
atoms in the isotropic pancake trap, for both signs of the interspecies scattering length. In the case 
of repulsive interspecies interaction, there are the axially-symmetric and symmetry-breaking ground 
states. The threshold for the symmetry breaking transition, which is related to appearance of a zero 
dipole-mode, is found numerically. For attractive interspecies interactions, the two condensates 
assume symmetric ground states for the numbers of atoms up to the collapse instability of the 
mixture. 
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I. INTRODUCTION 



Bose-Einstein condensation (BEC) in mixtures of trapped quantum gases has become an 
exciting field of study. First experimental observation of the two-species BEC was realized 
using two different spin states of 87 Rb The two overlapping condensates of 87 Rb in 
the spin states \F = l,m = —1) and \F = 2, m = 2) were created via nearly lossless 
sympathetic cooling of the atoms in the state |2, 2) by thermal contact with the atoms in 
the |1, — l)-state. Also, the double-condensate system of 87 Rb in the spin states |1, — 1) 
and |2, 1) was created from the single condensate in the |1, — l)-state by driving a two- 
photon transition 2j. In the subsequent evolution after creation, the condensates underwent 
complex relative motions preserving the total density profile. The motions quickly damped 
out and the condensates assumed a steady state with a non- negligible (and adjustable) 
overlap region. These experiments started a series of works devoted to experimental and 
theoretical study of BEC in mixtures. For instance, superposition of the spinor condensates 
of 23 Na led to observation of weakly miscible and immiscible superfluids [2| and occurrence 
of the metastable states 141. Interaction between two condensates of different spin states of 

n 

87 Rb in the displaced traps was observed in the center-of-mass oscillations [5j. Successful 
attempts to cool fermion gases to the quantum degeneracy regime by using the boson-fermion 
mixtures were also reported. First such mixture was achieved by using the two species of 
Li, the bosonic 7 Li and fermionic 6 Li 0, Q|. More recently, the experiments on mixtures of 
different atomic species were performed. Both boson-boson and boson-fermion pairs were 
cooled. The two species BEC of 41 K and 87 Rb 



and 2d Na- b Li 



and boson-fermion mixtures 87 Rb- 40 K 



ll| were achieved. 

A promising combination for obtaining the two-species BEC potentially rich in new phe- 
nomena is the mixture of two isotopes of Rubidium: 85 Rb and 87 Rb. There is a long standing 



12j |. where the feasibility 



interest in obtaining this BEC mixture, which goes back to Ref. 
of achieving such two-species BEC was established. It was suggested that condensation of 
the two isotopes of Rubidium can be achieved via the sympathetic cooling of certain hyper- 
fine states which exhibit low inelastic collision rates. Moreover, the possibility of employing 
the Feshbach resonance for control over the scattering length was stressed. The optimal 
combination was found to be the mixture of the spin states |2, — 2) 85 and |1, —1)87, because 
the scattering length between the isotopes can be controlled. The sympathetic cooling of 
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the 85 Rb condensate by thermal contact with the 87 Rb condensate was subsequently exper- 
imentally demonstrated Q|. Up to 10 6 atoms of the 85 Rb isotope were cooled via elastic 
collisions with a large reservoir (10 9 atoms) of 87 Rb. The stable condensate of the 85 Rb iso- 
tope was also created by using the Feshbach resonance to reverse the sign of the scattering 
length from negative to positive Q|. In this way, the long-living condensates with up to 
10 4 atoms of 85 Rb in the spin state |2, —2) were produced. 

One of the principal advantages of using the Rubidium isotopes is that their interspecies 
and intraspecies scattering lengths are known with a good precision thus theoretical 
predictions can be compared with the experiment. In particular, the scattering lengths of 
the 87 Rb isotope and between the two isotopes are positive, while the scattering length of 
the 85 Rb isotope is negative. 

Efficient interspecies thermalization crucially depends on the interspecies scattering 
length and the overlap region of the species. It is known that the spatial separation may 
take place depending on the values of the scattering lengths. If all atomic interactions in the 
mixture are repulsive, the following simple criterion for the spatial separation of two BECs 
in a box [3] is known: if the mutual repulsion is large enough, namely G12 > VG11G22 



(where Gij is the interaction coefficient), the condensates separate to lower the energy. The 
symmetry breaking point of view on the ground state in the mixture of condensates was 
d eve,o P ed in Refs. fiyHGilQ. For i„ by takbg e qUal ou mb e r of a t0mS b 
the two species, the symmetry-preserving vs. symmetry-breaking phase diagram was ob- 
tained in Ref. |Tj|. Existence of the metastable states in the BEC mixtures was argued also 



on the basis of the Bogoliubov excitation spectra in Ref. [2l|, where both signs of the in- 
terspecies scattering length were considered (for the repulsive intraspecies interactions). In 
Ref. 22] the two-species condensate with coinciding positive or negative interspecies scatter- 
ing lengths and equal numbers of atoms in the species were considered within a variational 
approach. However, the results of the latter work do not apply to the BEC mixture of 
the two isotopes of Rubidium, where, first of all, the interspecies scattering lengths have 
different signs. Finally, the collapse of a two-component BEC in the spherically symmetric 
trap was numerically studied in Ref. j^, where all possible combinations of signs of the 
atomic interactions for the two species were considered. It was found that, depending on 
the interaction coefficients, either one or both components may experience collapse. 



In the related theoretical studies of boson-fermion mixtures 



2J,|2 



23, |2a |2a all 
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possible signs of the boson and boson-fermion s-wave scattering lengths were considered (due 
to the strong s-wave scattering between bosons and fermions the p-wave contribution to the 



interspecies interaction is neglected, see Refs. |26l |29j). This reflects the fact that in the 
experiments on boson-fermion mixtures various combinations of the signs are possible, for 
instance, the two-isotope mixture of Lithium of Ref. [6| had attractive boson and repulsive 
boson-fermion interactions, while in Ref. |j| the same species were used in the different 
angular momentum states with the repulsive atomic interactions. Though the governing 
equations for the boson-fermion mixture are different from those for the two-boson BEC, 
the predicted effects, SU ch,as the phase separation Q H Q aad coHapse Q Q, have 



similar features. In Ref. 



f. H the comprehensive analysis of the properties of boson-fermion 
mixtures for all possible signs of the boson and boson-fermion s-wave scattering lengths is 
given. We will make connections to the results of the latter work in the following sections. 

In the present paper we study two-species BEC in a pancake trap, for the numbers of 
atoms below the collapse instability. Our main goal is to understand the ground state of 
the two-species BEC mixture comprised of the 85 Rb and 87 Rb isotopes, with the atoms 
being in the optimal spin states, |2, — 2)§5 and 1 1, — l)s7- We consider both the attractive 
and the repulsive interspecies interactions for fixed (default) intraspecies interactions with 

for |2, — 2) 85 and 107.5 a.u. (5.7 nm) for 



121. In section lUl we introduce the two- 



the scattering lengths: —412.5 a.u. (—21.8 nm' 
1 1,-1)87 — the averages of those given in Ref. 
dimensional model describing the two-species BEC mixture in a pancake trap and discuss 
the domain of its applicability. Then, we present the numerically found ground states in 
the BEC mixture of the two isotopes of Rubidium for the repulsive as well as attractive 
interspecies interactions, sections IIII Al and IHI Bl respectively. The concluding section 
contains brief summary of the results. Detailed derivation of the two-dimensional model is 
placed in appendix El while details of the stability analysis of the axially symmetric ground 
states are given in appendix iBl 

II. TWO-DIMENSIONAL MODEL FOR THE PANCAKE TRAP 

We consider two-species BEC mixture in the isotropic pancake trap for arbitrary in- 
traspecies and interspecies scattering lengths. The Gross-Pitaevskii equations for the two- 
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species BEC have the following form 

h 2 

= -- — V 2 ^i + + (Cul^al 2 + G , i 2 |^2| 2 )^i, (la) 

lVTL\ 

h 2 

ifid t ^ 2 = -—- V 2 ^ 2 + ^ 2 (r)^ 2 + (G 22 |^ 2 | 2 + G 12 |^ 1 | 2 )^ 2 , (lb) 

where ^i(r, t) and ^(t*, t) are the order parameters of the two species, while the interaction 
coefficients are given as G\\ = 47rH 2 ai/mi, G 22 = 47r?i 2 a 2 /m 2 , and G\ 2 = 27th 2 ai 2 /M, with 
ai, a 2 and a 12 being the intraspecies and interspecies scattering lengths, respectively. Here 
M denotes the reduced mass: M = mim 2 /(mi + m 2 ). In our case, for the two isotopes of 
Rubidium, we can neglect the mass difference between the isotopes and take m = mi = m 2 . 
We consider the parabolic pancake trap, 

mu 2 7 „ muo 2 , 
^ = -2^« 2 + -^ri, J = 1,2, (2) 

with strong confinement in the ^-direction: 7 = uj z /ujj_ ^> 1 (by a simple phase trans- 
formation the possible difference of the zero-point energies for the two species in the trap 
can be scaled away from system JT}). The difference in the magnetic trap frequencies felt 
by the two species is caused by the difference of the Lande magnetic factors for the two 
isotopes |3CJ: gr(|2, — 2)gs) = —1/6 and g(\l,— l)s7) = —1/4. The corresponding magnetic 
moments measured in the Bohr magnetons are given as follows: /iss = #(12, — 2)g5)m85 = 1/3 
and /x 8 5 = — 1)87)77187 = 1/4. Hence, the ratio of the squared trap frequencies is 
a>f 7 /u;f 5 = ^7/^85 = 3/4, where t^ss and u;87 stand for the frequencies experienced by the 
respective isotopes. From now on, the indices 1 and 2 will correspond to the isotopes 85 Rb 
and 87 Rb, respectively. 

For not too large numbers of atoms the three-dimensional system can be reduced to 
a system of two-dimensional equations in the pancake coordinates r± = (x,y), while the 
order parameter in the z-direction is fixed and given by the Gaussian. Indeed, the motion 
in the z-direction is quantized under the condition that the energy contribution from the 
nonlinearity is much less than the difference between the energy levels of the trap: 

' 31 ' < hw ltZ , ' 3 ' 2 < hu2 tg , j = 1,2. (3) 

Here we have estimated the order parameter as \^j\ 2 ~ Nj/ (dj iZ dj j_), j = 1,2, with in- 
troduction of the effective sizes of the condensates in the pancake plane (dj ±) and in the 



^-direction (dj )Z ). Under condition (j3J), the z-sizes of the condensates are given by the trap 
size: dj <z = ctj tZ , with a^ z being the respective oscillator length in the ^-direction (see formula 
(0))). Whereas their sizes in the pancake plane must be determined from the solution to the 
resulting two-dimensional system (system © below). We will reformulate condition in a 
more convenient form below. More detailed analysis of the two-dimensional approximation 
is placed in appendix |XJ 

Under condition Q the order parameter ^ is approximated as a product of the Gaussian 
wave function in the ^-direction and a wave function describing the transverse shape: 

*i = e-^'^mssiru t), fi = ex P (-^) . = (^-) • (4) 

The Gaussian is the ground state wave-function of the linear part of the r.h.s. in system 
which correspond to the quantum motion in the z-direction: Hj Z = —ti 2 / (2m)d 2 +muJ 2 z z 2 /2, 
with Hj >z fj(z) = (hujj tZ /2)fj(z). Substitution of expression (j^J) in system (JTJ), multiplication 
of the equation for tyj by fj(z) and integration over z results in the approximate two- 
dimensional system (see also equations (|A3j) - (|A4|) from appendix EJ. To write it down in a 
form convenient for numerical calculations, let us introduce the dimensionless variables: 



/ ^ \ 1/2 

a ± =( , T=-±t, ^ = a ± ^, J = 1,2. (5) 



r± / i, \ 

P = — 

a± 



Here we have defined the frequency uj_ as u>j_ = (u>f ± + ui% ± )/2, where j = 1,2, 

are the trap frequencies in the pancake plane experienced by the two isotopes. Then the 
dimensionless approximate 2D system reads: 

id T ^ = -V^x + Ay^i + ^iil^il' + ^I^H^i, (6a) 

id T ^ 2 = -Vl^J 2 + X 2 2 p 2 ^2 + {922\H 2 + 9i2\H 2 )^2, (6b) 

where p = \p\, 



_ A\f2nai _ A\f2na 2 8y/7ra 12 . _ w lt ± _ w 2 ,± 

9ll — > 922 — > 9l2 — Y~2 ; 2 \1/9> Al ~ ' A 2 _ \' ) 

a 1>z a 2:Z [atz + a 2,z)' u± u± 

Using the relation uj^/uj 2 = 3/4 for the Rubidium isotopes in the spin states |2, — 2) 85 and 
|1, —1)87, we obtain: = 8/7 and X 2 = 6/7. 

The pancake trap sizes in the experiments on BEC have different values. To set a reference 
for discussion, in the calculations below we assume the z-size of the trap to be 10/xm, i.e., 



we set di >z = 10/iin (a 2>z = 2.03~ 1//4 ai i , 2 = 0.84ai^). This results in the following values for 
the interaction coefficients in the mixture of the two isotopes of Rubidium: gu = —0.0219, 
g 22 — 0.00 68, and gi 2 = 0.012. For a different trap size the interaction coefficients will 
change. However, the quantities guNi, g 22 N 2 , gi 2 N 2 , and g± 2 Ni, computed on a solution to 
system ©, will remain invariant under the variation of the trap size. Thus, a different trap 
size a z will result in a similar solution but for the appropriately scaled numbers of atoms. 
We will return to this point below. 

Let us now reformulate condition (JHJ) in a form more convenient for verification. Scaling 
the sizes of the condensates in the pancake plane by the respective trap length, dj ± = Rja±, 
we obtain the equivalent conditions in the form of the bounds on the numbers of atoms: 

AT ^ R l ■ ( az az \ AT ^ R 2 ■ ( az fa\ 

iVi < 7— mm - — -, , N 2 < 7— mm - — -, , (8) 



AlT \l a l| l a 12|/ 47T \l a 2| I CI 12 1 

where a z denotes both ai jZ and a 2tZ , since they have close values, and 7 ^> 1 (7 = uj z /uj±_ = 
a 2 ± /a>l). The sizes R\ and R 2 of the two condensates must be determined from the solution 
of system For instance, for the pancake trap with a z = 10/zm, using the values of the 
scattering lengths from section U for the 85 Rb- 87 Rb mixture, we obtain the following bounds: 
Nj 10 2 7-R|, j = 1,2. The actual bounds on the numbers of atoms are thus determined 
by the trap anisotropy 7. For example, if 7 = 100 (i.e., a± = 10a z ) we have Nj 10 4 i? 2 . 

There is the critical number of atoms iV c such that the 85 Rb condensate, in the absence 
of the other isotope, is unstable with respect to collapse for iV 8 5 > N c . By setting g 12 = in 
the two-dimensional system we obtain the following expression for the critical number 
of the 85 Rb atoms necessary for collapse (in the absence of the other isotope): 

27r/ Vnl a l z ai x , . 

N c = 1 1 = —7=- 1 1 = K 2D 1 , 9 

Ifl-iil 2V2 |ai| |ai| 
where k 2 d = 1.167. In the derivation of formula we have used the well-known condition 



for collapse in the critical nonlinear Schrodinger equation (for details consult Ref. |3l|) 
and that the number of particles N in the so-called Townes soliton is A^ = 2irl , where 
I = 1.862. 

It is important to notice that both the upper bound (jHJ) on the admissible numbers of 
atoms and the threshold number for collapse © in the 85 Rb condensate are proportional 
to the trap size in the ^-direction. Thus, taking a bigger pancake trap (with the same 7) 
will relax the bounds on the numbers of atoms. The threshold for collapse in the mixture 



of the two isotopes of Rubidium also depends on the number of atoms of the 87 Rb isotope. 
However, we have found numerically that this dependence is very weak (the correction does 
not exceed 5% for the numbers of atoms used below and the fixed default scattering lengths), 
therefore, the threshold given by can be taken as a good approximation. For example, 
for the pancake trap with a z = 10/im, used above, the threshold for collapse is N c = 535. 

Finally, let us comment on the validity of the approximate 2D system for description of the 
collapse instability in the mixture. First of all, one may point out that the threshold value 
for collapse of the mixture in the pancake trap determined from the full three-dimensional 
system (0) may turn out to be lower than that predicted by the two-dimensional approxi- 
mation, as it is true, for instance, for the single species condensate of 85 Rb. Indeed, in the 
latter case, the exact (i.e., 3D) threshold can be written as N c = n{^)a z /\ai\ 32]. Using 
the numerically found values of ^(7) from Ref. (3^], we conclude that ^(7) < k^d for any 
7 > 1, i.e., this inequality holds for any pancake trap. As 7 — > 00, the function ^(7) slowly 
iends to k,2D- For example, for the trap with a z = 10/im and 7 = 100 we have k(100) = 1.1 
32I ] what gives 95% (506 atoms) of the threshold given by formula (jHJ). 

Nevertheless, in the pancake trap, the instability which is solely due to the three- 
dimensionality is weak if the conditions given by (jHJ) are satisfied and the numbers of atoms 
are not much greater than the corresponding instability threshold. This conclusion follows 
from the general discussion of the 2D approximation, which is placed in appendix EI Here 
we note also that the instability rate due to the 3D effects decreases with increase of the 
trap anisotropy 7 (since it enters the r.h.s.'s of the conditions in equation (jHJ)). Therefore, 
in a sufficiently anisotropic pancake trap, the 3D collapse instability below the threshold 
of the 2D collapse does not have enough time to develop on the time scale set by the two- 
dimensional system (jUJ) and, hence, its effect on the solutions can be neglected. In fact, 
the time necessary for such a weak instability to develop may exceed the life-time of the 
condensates in the mixture. 

It is, however, the dynamics of a collapsing condensate in the pancake trap that cannot 
be treated in the framework of the two-dimensional approximation and requires the full 3D 
analysis due to violation of at least one of the two conditions (jHJ). Thus we will not discuss 
such dynamics. For more details on the two-species collapse in BEC consult, for instance, 



28, 



29]. 



Ref. [23] and on the collapse in boson-fermion mixtures consult Refs. 

In the case of the two-species BEC of 85 Rb and 87 Rb, there is a stable state in the 



S 



mixture, predicted by the 2D system (JBJ) for the numbers of atoms slightly lower then the 
collapse instability (see the next section), which violates the applicability conditions (JHJ) for 
modest pancake traps (7 < 100) due to sharp contraction of the 85 Rb condensate. The 
sharp decrease of the 85 Rb condensate size Ri, predicted by system (|Hjl. requires large trap 
anisotropy 7 for the 2D system to sustain its validity. Therefore, for the current experimental 
traps, the very existence of such exotic states requires the full 3D analysis and thus is beyond 
the 2D approximation adopted in the present paper. We will not discuss such states either. 

Therefore, for the current experimental pancake traps, the applicability of the approxi- 
mate 2D system (JHJ) is limited by the threshold of formation of the contracted states in the 
85 Rb condensate. In the next section we discuss the ground states in the mixture for the 
allowed numbers of atoms and their deformations due to the instabilities predicted by the 
2D system, such as the symmetry-breaking transition. Such instabilities are much stronger 
than those due to the three-dimensional effects and, consequently, are observed on much 
shorter time scale (consult also appendix lAj) . 

III. GROUND STATES IN THE MIXTURE OF TWO ISOTOPES OF RUBIDIUM 

Now we turn to the numerical solution of system © to find possible ground states in the 
BEC mixture of the two isotopes. The stationary solutions are sought for in the usual form: 

^ = e-^U.ip), ^ 2 = e-^ T U 2 (p), (10) 

where fi± and fi 2 are the dimensionless chemical potentials for the two species. We have 
used the gradient method for the constrained energy minimization to find U\(p) and C^O?) 
minimizing the energy functional 

s = J d 2 P {|v^i| 2 + |v^ 2 | 2 + pWI^iI 2 + *l\H 2 ) + 9 -f\H 4 + 9 f\H 4 + 

(ii) 

for fixed numbers of atoms N% = J d 2 p\tpi\ 2 and N 2 = J & 2 p\ip2\ 2 - 
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A. Ground states for repulsive interspecies interaction 



Let us start with considering the BEC mixture of 85 Rb and 87 Rb atoms with the repulsive 
interspecies interaction. First of all, we have found the axially symmetric ground states via 
the energy minimization restricted to the space of the axially symmetric functions. It is 
important to know if the symmetric states are stable. The stability analysis cab be based on 
the method of Refs. 0, y^J , whose adaptation to our problem is described in appendix [Bl 
We have found that the axially symmetric ground state of the mixture suffers from the 
dipole-mode symmetry-breaking instability for sufficiently large number of atoms in the 
87 Rb condensate and not too large numbers of atoms in the 85 Rb condensate (N 85 < 500). 



The symmetry 



in Refs. 



17 



jreaking instability was previously discussed for the case of BEC mixtures 
| . The novelty here lies in the fact that one of the condensates has 



18, 



19 



attractive atomic interaction. For instance, the separation criterion of Ref. [15[ for a BEC 
mixture in the box, i.e., g i2 > v / fi , nfi , 22, looses its meaning since in our case gng22 < and, 
a priori, it is not evident that the isotopes would separate at all. 

The axially symmetric ground states on the threshold of the symmetry-breaking insta- 
bility for various numbers of atoms are shown in figure ^ It should be stressed that there 
are three types of the stable axially symmetric states in the system for smaller numbers 
of atoms, which correspond (and are similar) to the threshold states shown in figure ^ (0 
when the isotopes are strongly mixed (the two condensates have bell-shaped form, the doted 
lines), (ii) when the 85 Rb isotope is on the surface of 87 Rb (|^i| has a local minimum at 
the center, the solid lines), and (in) when the 87 Rb isotope is on the surface of 85 Rb isotope 
(|^2 1 has a local minimum at the center, the dashed lines). 

The threshold of the symmetry-breaking instability strongly depends on the numbers of 
atoms and corresponds to appearance of a zero dipole mode (which pertains to the orbital 
operator A n , consult appendix [Bj). From the energetic point of view, the separation takes 
place when the energy gain due to the intraspecies interaction in the strongly mixed state 
is higher than the kinetic energy (quantum pressure) at the interface between the separated 
condensates. The corresponding symmetry-breaking diagram, found numerically, is given in 
figure El 

Though all three types of the axially symmetric ground states discussed above suffer from 
the symmetry-breaking instability with increase of the number of atoms of the 85 Rb isotope 
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_5-4-3 -2-1 1 2 3 4 5 
X 

FIG. 1: The three types of the axially symmetric state in the mixture of 85 Rb and 87 Rb isotopes 
on the threshold of the symmetry-breaking instability. The one-particle wave functions are shown 
(scaled for better visibility as is indicated on the y-axis). The numbers of atoms are as follows. 
Solid lines: iV 85 = 100 and N 87 = 17412; dotted lines: A^ 85 = 300 and N S7 = 2042; and dashed 
lines: N 85 = 450 and iV 8 7 = 894. 

(for sufficiently large number of atoms of the 87 Rb isotope) the symmetry-restored states 
(found to the right of the phase separation curve in figure EJ) , which result from further 
increase of the number of 85 Rb atoms, are of type (Hi), i.e., when the 87 Rb isotope is on the 
surface of the 85 Rb isotope. 

In the reduced 2D system (|S|L with further increase of the number of 85 Rb atoms the 
symmetry-restored state of type (Hi) is immediately followed by a sharp contraction of the 
85 Rb condensate and subsequent collapse instability at N 85 ps 535. The collapse instability 
is due to appearance of the axially symmetric unstable mode (i.e., the unstable linear mode 
with the orbital number / = 0, see appendix [Bj) . The collapse threshold value of N$5 only 
slightly decreases with increase of the number of 87 Rb atoms. This is due to the very 
favorable set of the default scattering lengths of the system and is not a general property 
of the mutually-repulsive mixtures of attractive and repulsive species. For instance, in 
the related study of the boson-fermion mixtures, it was noted that though the collapse 
in the mutually-repulsive boson-fermion mixture with attractive boson interactions only 
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FIG. 2: The symmetric vs. asymmetric ground state diagram. The interaction coefficients are: 
gn = —0.0219, 522 = 0.0068, and gi2 = 0.012 (computed for the default values of the scattering 
lengths and a\, z = 10 jum). The logarithmic (base 10) scale is used for the 87 Rb-axis. 

concerns the boson species, it can be strongly affected by the fermion number of atoms j^l . 
However, for such effect to be pronounced, the interspecies s-wave scattering length must 
be significantly larger than the absolute value of the boson scattering length. 

Thus, right before the collapse instability the size of the 85 Rb condensate first decreases 
to a fraction of the trap size a±. However, depending on the trap anisotropy 7, such a 
state may violate the first of the two applicability conditions (jHJ for the 2D approximation. 
For example, our estimates show that accurate description of this effect requires the full 
3D analysis for the pancake traps with 7 < 100. For observation of this effect, much more 
anisotropic pancake traps are required, which are not used in the current experiments. Thus 
we will not discuss the effect any further. There is also an implication on the validity of a 
part of figure El for the current pancake traps: the 2D approximation for the pancake trap 
with 7 < 100 is not valid for description of the symmetric ground states to the right of the 
separation curve except a narrow strip immediately after it (with the width equal to a dozen 
of atoms on the N 85 axis). 

The symmetry-breaking ground states are illustrated in figures H3 and EJ where we show 
the contour lines of the order parameters (ranging from the maximum to half of its value at 
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FIG. 3: The symmetry-breaking ground state for not too large number of 87 Rb atoms. For each of 
the two condensates, the equidistant level curves ranging from the maximum of the order parameter 
to a half of its value are shown. 

a constant step) for 85 Rb (solid lines) and 87 Rb (dashed lines). We have found that it is the 
85 Rb condensate that is expelled from the center of the trap in the symmetry-breaking states. 
It is seen that for comparable numbers of atoms of the two species it is the 87 Rb condensate 
that suffers the strongest deformation from the bell-shaped form, while for N$5 the 

85 Rb condensate is strongly deformed. Here we note that the asymmetric ground state of 
the mixture is degenerate, as it possesses the rotational zero mode. In other words, the 
maximum of the order parameter of 85 Rb can have arbitrary position angle on the surface 
of the 87 Rb condensate. 



B. Ground states for attractive interspecies interaction 

Now let us consider the BEC mixture of the two isotopes when the interspecies interaction 



12 1. It is 



is attractive, which can be experimentally realized by using the Feshbach resonance 
convenient to measure the interspecies interaction coefficient in terms of the interaction 
coefficient gxi of the 85 Rb isotope. We have found that the condensates do not separate 
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FIG. 4: The asymmetric ground state for very large number of 87 Rb atoms. The equidistant level 
curves are shown with the range defined as in the previous figure. 



in this case and assume the axially symmetric ground state up to the collapse instability 
threshold. Such ground states are illustrated in figure El where we plot the appropriately 
scaled one-particle wave-functions for the two condensates. Note the local peak at the center 
of the 87 Rb condensate. Appearance of this peak is easy to understand, for instance, when 
the Thomas- Fermi limit applies to the 87 Rb condensate (which corresponds to the picture in 
the lower panel of figure EJ). Indeed, if Ng? 3> N S5 , then in the zero-order approximation one 
can neglect the contribution from the interspecies interaction term gi2|Vh| 2 m equation (j6b|) 
for the 87 Rb condensate in the region away from the trap center. Thus, in the zero-order 
approximation, the 87 Rb condensate has the Thomas-Fermi ground state independently of 
the state of the other isotope. Therefore the effect of the cross-interaction term t?i2 1^2 1 2 in 
the equation for the 85 Rb condensate (jfiaj) is now similar to that of an additional potential. 
In the next order of approximation, the order parameter ip2 of the 87 Rb condensate is a sum 
of the two terms: the background Thomas-Fermi shape and the local deformation at the 
center of the trap. The latter is determined by the order parameter of the 85 Rb condensate. 
It is interesting to note that a similar central density enhancement of the fermion species in 
the boson-fermion mixtures with attractive interspecies interactions is predicted in Ref. 



14 



00 



X 
LO 



LO 

oo 



oo 



X 
O 



LO 
00 



N 85 = 400 
N 87 = 500 



\ 




10 
8 
6 
4 
2 


-4 -3 -2-1 1 

X 

10 
8 
6 
4 
2 




— g 12 = 





9 12 


O.Sxg^ 


9 12 


0.75x gii 



N 85 = 400 
N ov = 5000 

Of 



= 0.4x g H „ 

g„„ = 0.5x g H „ 



/ 



N 



-4 -3 -2-1 1 

X 



FIG. 5: Stable ground states of the BEC mixture for the attractive interspecies interactions. The 
one-particle wave functions (scaled for better visibility as indicated along the y-axis) are shown. 
In both panels, the solid lines correspond to the 85 Rb isotope and the dashed lines to the 87 Rb 
isotope. 

(figures 1 and 2). 

It should be noted that, notwithstanding the attraction in the 85 Rb condensate and the 
attractive interspecies interaction, the ground states shown in figure El are not self-bound, 
i.e., they are not solitons: relaxation of the trap results in spreading of the condensates. 

Finally, lowering of the interspecies interaction coefficient g\% to the sufficiently large 
negative values results in sharp contraction of the 85 Rb condensate which is followed by the 
collapse instability. This contraction of the stable ground state of the 85 Rb condensate to a 
fraction of the trap size is due to the presence of the other condensate, since the size of a 
stable single species BEC is always on the order of the trap size. 
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Thus, as in the case of the repulsive interspecies interactions, the collapse instability in the 
mixture is preceded by a sharp decrease of the 85 Rb condensate size. Therefore, depending 
on the trap anisotropy 7, its description may take us beyond the 2D approximation adopted 
in this paper. For most of the current pancake traps 7 < 100, thus the description of the 
ground state in the mixture which is on the border of the collapse instability requires the 
full three-dimensional analysis. 

We note, however, that for small values of \gu\ the stable symmetric ground states pre- 
dicted by the 2D approximation and illustrated in figure El can be experimentally observed 
in the current pancake traps with 7 ~ 100. In such experiment, the number of 85 Rb atoms 
should be below the threshold value N c = N c (N 8 i) which, for fixed g^, decreases only by a 
few percent from the value given by formula (jHJ) with increase of the number of 87 Rb atoms. 



IV. CONCLUSION 



We have studied the ground state in the BEC mixture of two isotopes of Rubidium in 
the pancake trap for repulsive and attractive interspecies interactions and fixed (default) 
intraspecies interactions. 

In the case of repulsion between the two species, there is the symmetry-breaking deforma- 
tion of the ground state due to the dipole-mode instability, whose threshold strongly depends 
on the numbers of atoms of the two isotopes. For small numbers of atoms, i.e., below the 
symmetry-breaking instability threshold, the stable axially symmetric ground state has the 
form of either the strongly mixed state of the species (with the order parameters of the two 
condensates having the bell-shaped form) or the state where one of the condensates forms 
a circular strip on the surface of the other. 

For attractive interspecies interaction, the condensates assume the axially symmetric 
ground states for all numbers of atoms where the 2D approximation is valid. For small 
values of the (negative) interspecies interaction coefficient \gi2\ the mixture is stable for 
the numbers of 85 Rb atoms below the critical value N c = N C (N 87 ) which is a few percent 
lower then the collapse instability threshold for a single species condensate of 85 Rb (i.e., for 
gu = 0). There is a sharp peak in the density of the repulsive 87 Rb isotope due to the 
attractive interspecies interactions - the effect which is similar to the enhancement of the 
fermionic density in boson-fermion mixtures with attractive boson- fermion interactions j^j . 
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Finally, for the pancake traps with the anisotropy 7 < 100, the 2D approximation for 
the attractive as well as repulsive mixture is violated at the numbers of atoms in the 85 Rb 
condensate just below the collapse instability in the 2D model due to the sharp contraction 
of the 85 Rb condensate. This is quite dissimilar to the case of the single species BEC of 
85 Rb, where the collapse sets in at a state which has the size comparable to the trap size 
in the pancake plane. Thus, the investigation of the actual ground state of the mixture in 
such pancake traps at the numbers of atoms close to the collapse instability requires the full 
three-dimensional analysis and is beyond the approach adopted in the present paper. This 
sets a direction for the future research. 
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APPENDIX A: DERIVATION OF THE TWO-DIMENSIONAL APPROXIMA- 
TION 

The system (£[} can be rewritten in the following form: 

ihd t *i = {H lz + H 1X + Gnl^il 2 + G 12 |^ 2 | 2 ) * ls (Al) 
ihd t ^ 2 = (H 2z + H 2L + G 22 \^ 2 \ 2 + G 12 \^i\ 2 )^2, (A2) 

where we have introduced the linear operators corresponding to the quantum motion along 
z-axis and on the (x, y)-plane in the trap: 

H ^-^ + V ^ *ix=~V ± + lWrJ, , = 1,2. 



The solution to equations (|Al)) - ((A2j) can be expanded over the eigenfunctions of the 
linear operators H\ z and H 2z as follows: \F,- = ^/j (z,r±,t) + tyj(z,r±,t), j = 1,2, where 
tyjo = e~ tEjot / h fj(z)&j(r±,t), with fj(z) being the normalized eigenfunction of the ground 
state, Hj Z fj(z) = Ej fj(z), while the second term, \F,-, is the projection of order parameter 
tyj on the subspace orthogonal to the ground state. 
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We can expand the system (|A1|) - (|A2|) in similar way using the projectors 111 and II2 on 
the ground states of H\ z and H 2z , respectively. Application of these projectors to equations 
(IAl|) - (jA2|) leads to the system describing evolution of the projection of the order parameters 
for the two species on the respective ground states: 

iW t $ x = ( J ff 1± + G 11 |$i| 2 + G 12 |$ 2 | 2 + A 1 )$ 1 +^ 1 , (A3) 
ihd&2 = (h 2 l + G 22 \® 2 \ 2 + G l2 \$ l \ 2 + A 2 ) $ 2 + Ti, (A4) 

where G tJ = (hjjfff). with (F) = f Fdz, 

A, = (; n (fj(2fM,{^]} + |^f)> + G,,3- J (/ 2 (2/ 3 - J Re{$3-^3- J } + |*3-;| 2 )>, (A5) 

and 

?i = GM\*i\%) + G jflH <Ji\**-i\%)- (A6) 
On the other hand, the equations describing evolution of the projections of the order parame- 
ters on the orthogonal subspaces are derived by application of the complementary projectors 
Qj, Qj = 1 - Uj, to the system (|A"T| -(lA"2l): 

ihdti?! = (H lz + tf 1± ) + Q x {Gnl^xl 2 ^! + Gi 2 |* 2 r*i} , (A7) 
iHdt*2 = (h 2z + H 2 ^j i> 2 + Q 2 {G 22 |^ 2 | 2 ^ 2 + G 12 |^i| 2 ^ 2 } , (A8) 

where Hj Z = Hj Z — Ej . 

Let us estimate the orders of magnitude of the nonlinear terms in equations (|A3)) - (|A4)) 
and (|A7|) - (jA8|) under the condition that the nonlinear terms in the system (IAl|) - (jA2|) are 
much smaller than the characteristic difference AE ~ hio z between the eigenvalues of each 
of the two linear operators H\ z and H 2z (i.e., the conditions (J3J) are satisfied). Below we 
will not distinguish between the quantities with different indexes, since all quantities of the 
same kind are of the same order of magnitude. Introduce a small parameter e as the ratio 
of the nonlinear terms in the system (|A3|) - (jA4|) to AE, that is 

( =^ = S«. (A9) 
AE AE v ' 

Note that (/ 4 ) ~ f 2 since the integral of f 2 over z is of order 1. It is the smallness 
of e, supposed in (jSJ), that justifies the transition to the two-dimensional approximation. 
Indeed, the order of the correction ^ to the factorized wave function can be found by 
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equating the orders of the inhomogeneous term and the linear term H z + H± in (|A7jl - 
(|A8|) . where, as in ()A3|) - ()A4|) . we have again ~ eAEty and can be neglected 

compared with H z ~ AE. Therefore, we get AE^f ~ GQ{\f$\ 2 f&} ~ eAEf§ and, hence, 
\j> ^ e/$. From this we obtain the estimates for the terms given by equations (jA5|) and 
(jMD: A ~ G(/ 2 /^^) ~ eG/ 2 $ 2 ~ e 2 AE and J" ~ G(/(/$) 2 e/$) ~ eG/ 2 $ 2 $ ~ e 2 $A£. 

Throwing away the terms of the order e 2 from equations (|A3|) - (jA4|) and changing to the 
dimensionless variables given by (jSJ) we arrive at the system ©. The projection of the order 
parameter ^ on the orthogonal subspace, 4fj, is of order e and can be neglected compared to 
the factorized wave function fj$j- We conclude that, under the conditions (jBJ), nonlinearity 
plays significant role only on the pancake plane {x,y). 

Two comments are in order on the two-dimensional approximation described above. First, 
the effects due to three-dimensionality of the mixture will be of order e 2 , the same order as 
the terms we have thrown out from the system ()A3|) - (jA4|) . thus they will give a significant 
contribution to the dynamics only on the time scale of order e -2 , much longer then the 
time scale of the nonlinear effects in 2D, which is of order e~ l . Second, a similar 2D ap- 
proximation will be valid for the linearized system which describes the evolution of a small 
perturbation of the solution. Thus, any instability in the mixture which is solely due to 
its three-dimensionality will be of order e 2 and will not play any role on the time scale we 
consider. 

The latter comment concerns, for instance, the instability due to collapse in 3D: although 
the 3D threshold value of the number of atoms in the mixture necessary for collapse may turn 
out to be lower than that in the 2D approximation, as it is true for the single species con- 
densate of 85 Rb, the corresponding instability rate (proportional to the unstable eigenvalue) 
will be of order e 2 and will not be noticed on the time scale we consider. 

APPENDIX B: THE LINEAR STABILITY ANALYSIS 

The linear stability analysis is based on the consideration of evolution of a linear pertur- 
bation u\ = ui(p, T) and u 2 = u 2 (p, T) of the stationary state (Ui(p), U 2 (p))- The evolution 
equations for the perturbation are derived by linearization of the original system (system 
(jnj) about the stationary solution. One looks for the eigenfrequencies u of the resulting 
linear system by setting Uj = e~ tuJt (Xj(p) + iYj(p)), j = 1,2. Appearance of an imaginary 
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eigenfrequency means instability. In particular, by writing the perturbed solution as 



^ = e - i ^ T (U j (p) + u j (p,T)), j = 1,2, (Bl) 

using this in the system © and keeping only the linear terms in u\ and u<i we arrive at the 
following eigenvalue problem (consult also Refs. 







-H > M = H > A « = ( B2 ) 




Here (j = 1,2): 



L Q . = -Vl+ ^ g jm U 2 m {p) + \ 2 p 2 



m=l,2 



(B3) 



L y = 9 r mUl(p) + 2g J ,U 2 (p) + X 2 J p 2 



m=l,2 

Expansion of the eigenvalue problem ()B2|) in the Fourier series with respect to the polar 
angle 9 leads to an infinite series of one-dimensional eigenvalue problems of similar form for 
the orbital projections of the vectors (Xi,X 2 ) T and (Yi,y 2 ) T , 

X^Y^^AP^ + cc, Y j = J2Y jl (p)e iW + c.c., j = 1,2, (B4) 



l>0 l>0 



with the orbital operators defined by A oi = A (V]_ — ► — l 2 /p ) and = A X (V 



Vp — l 2 /p 2 ), where = d 2 + p~ l d p . However, only a few of these ID eigenvalue problems 
need to be considered to decide on stability of the axial ground state. Indeed, first, as 
follows from the general criterion for stability of the ground state in a system of nonlinear 
Schrodinger equations [3| , in the two-component system the axial ground state is unstable 
if there are at least three negative eigenvalues of the operator A x . For instance, if each of 
the first three orbital operators A^, I = 0, 1,2 has a negative eigenvalue, then the ground 
state is unstable. Second, as the orbital operators satisfy the obvious inequality Au 2 > 
(understood as the inequality for the mean values) for I2 > l\, it is sufficient to consider just 
three orbital problems arising from (|B2)1 with the orbital numbers I = 0,1,2. This is the 
approach we adopted. 

Finally, we would like to mention that the linear stability is closely related to the energy 



minimization (consult also Refs. [33|,|3J|). Indeed, the operator A is non-negative (it has 
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two zero modes due to the phase invariance of the system ©)• Thus, from the energetic 
point of view, a negative eigenvalue of the operator Ai corresponds to a negative direction 
in the free energy functional, defined here as the Lagrange-modified energy functional: T = 
E — \i\N\ — H2N2, evaluated at the axially symmetric state (Ui(p), [^(p)), since the operator 
Ai enters the second-order term in the free energy expansion with respect to the perturbation 
u j = X j {p)+iY j {p),j = 1,2: 





5 2 F = 2j d 2 p I (Y 1 ,Y 2 )A 1 + (Xi,X 2 )A l Ml. (B5) 



Taking into account that there are two independent constraints on the numbers of atoms 
in the two species we conclude that only two negative directions may be eliminated by the 
energy dependence on the numbers of atoms. Therefore, for fixed numbers of atoms, the 
axially symmetric state is definitely not an energy minimum if there are three (or more) 
negative eigenvalues of the operator Ai. This explains the physical origin of the above 
mentioned sufficient condition for instability. We note also that the dipole-mode instability 
(i.e., existence of the unstable orbital mode with the orbital number I = 1) simply means 
appearance of an asymmetric state which minimizes the energy, i.e., the symmetry-breaking 
transition. 
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